Auditory and motor priming of metric structure improves understanding of degraded speech.

Speech comprehension is enhanced when preceded (or accompanied) by a congruent rhythmic prime reflecting the metrical sentence structure. Although these phenomena have been described for auditory and motor primes separately, their respective and synergistic contribution has not been addressed. In this experiment, participants performed a speech comprehension task on degraded speech signals that were preceded by a rhythmic prime that could be auditory, motor or audiomotor. Both auditory and audiomotor rhythmic primes facilitated speech comprehension speed. While the presence of a purely motor prime (unpaced tapping) did not globally benefit speech comprehension, comprehension accuracy scaled with the regularity of motor tapping. In order to investigate inter-individual variability, participants also performed a Spontaneous Speech Synchronization test. The strength of the estimated perception-production coupling correlated positively with overall speech comprehension scores. These findings are discussed in the framework of the dynamic attending and active sensing theories.

Neural dynamics of predictive timing and motor engagement in music listening.

Why do humans spontaneously dance to music? To test the hypothesis that motor dynamics reflect predictive timing during music listening, we created melodies with varying degrees of rhythmic predictability (syncopation) and asked participants to rate their wanting-to-move (groove) experience. Degree of syncopation and groove ratings are quadratically correlated. Magnetoencephalography data showed that, while auditory regions track the rhythm of melodies, beat-related 2-hertz activity and neural dynamics at delta (1.4 hertz) and beta (20 to 30 hertz) rates in the dorsal auditory pathway code for the experience of groove. Critically, the left sensorimotor cortex coordinates these groove-related delta and beta activities. These findings align with the predictions of a neurodynamic model, suggesting that oscillatory motor engagement during music listening reflects predictive timing and is effected by interaction of neural dynamics along the dorsal auditory pathway.

Reconstruction and localization of auditory sources from intracerebral SEEG using independent component analysis.

Stereo-electroencephalography (SEEG) is the surgical implantation of electrodes in the brain to better localize the epileptic network in pharmaco-resistant epileptic patients. This technique has exquisite spatial and temporal resolution. Still, the number and the position of the electrodes in the brain is limited and determined by the semiology and/or preliminary non-invasive examinations, leading to a large number of unexplored brain structures in each patient. Here, we propose a new approach to reconstruct the activity of non-sampled structures in SEEG, based on independent component analysis (ICA) and dipole source localization. We have tested this approach with an auditory stimulation dataset in ten patients. The activity directly recorded from the auditory cortex served as ground truth and was compared to the ICA applied on all non-auditory electrodes. Our results show that the activity from the auditory cortex can be reconstructed at the single trial level from contacts as far as ∼40 mm from the source. Importantly, this reconstructed activity is localized via dipole fitting in the proximity of the original source. In addition, we show that the size of the confidence interval of the dipole fitting is a good indicator of the reliability of the result, which depends on the geometry of the SEEG implantation. Overall, our approach allows reconstructing the activity of structures far from the electrode locations, partially overcoming the spatial sampling limitation of intracerebral recordings.

The effect of familiarity on neural tracking of music stimuli is modulated by mind wandering.

One way to investigate the cortical tracking of continuous auditory stimuli is to use the stimulus reconstruction approach. However, the cognitive and behavioral factors impacting this cortical representation remain largely overlooked. Two possible candidates are familiarity with the stimulus and the ability to resist internal distractions. To explore the possible impacts of these two factors on the cortical representation of natural music stimuli, forty-one participants listened to monodic natural music stimuli while we recorded their neural activity. Using the stimulus reconstruction approach and linear mixed models, we found that familiarity positively impacted the reconstruction accuracy of music stimuli and that this effect of familiarity was modulated by mind wandering.

Hippocampal intracerebral evoked potentials as a marker of its functionality in drug-resistant epilepsy.

OBJECTIVES: To assess hippocampal function during stereoelectroencephalography (SEEG) investigations through the study of the medial temporal lobe event-related potential (ERP) MTL-P300. METHODS: We recorded the MTL-P300 during a visual oddball task, using hippocampal electrodes implanted for SEEG in 71 patients, in a preoperative epilepsy investigation. The presence of an MTL-P300 and its amplitude were correlated with hippocampal involvement during seizures and memory function. RESULTS: Analysis using ROC curves revealed that an MTL-P300 amplitude below -46 µV, has a specificity of 93.3% in detecting the epileptogenic zone, and absence of the MTL-P300 in the left hippocampus of patients with typical language organization was associated with marked alteration of verbal memory scores. There was a significant correlation between performance in non-verbal memory tests and the amplitude of the MTL-P300 in the right hippocampus of patients with left hemispheric seizures (immediate visual recall: r = 0.67, p = 0.005; delayed visual recall: r = 0.56, p = 0.025). Using a linear regression, we confirmed that the absence of the MTL-P300 in the left hippocampus, the involvement of the left hippocampus during seizures, and the duration of epilepsy were predictors of verbal memory deficits. CONCLUSION: Analysis of the MTL-P300 during SEEG recording provides relevant information for the analysis of hippocampal functionality and can help to localize the epileptogenic zone.

The effect of speech degradation on the ability to track and predict turn structure in conversation.

Conversation represents a considerable amount of the daily language usage and plays an important role in language acquisition. In conversation, listeners simultaneously process their interlocutor's turn and prepare their own next turn. As such the turn-taking dynamics heavily relies on prediction. In other words, listeners avail prior knowledge to constrain both speech perception and production. Here we explored the relation between prediction and comprehension while watching two interlocutors having a conversation. We capitalize on gaze switch as a proxy of predictive behaviour to class dialogue turns as more or less well predicted and explore how this affects dialogue comprehension. Moreover, we study the extent to which speech degradation, by increasing the global uncertainty of the context, affects the relation between predictions, brain correlates of prediction errors (N400) and global comprehension. Results show that 1) listeners direct gaze to the current speaker, in particular in challenging conditions, 2) gaze behaviour possibly affects the semantic processing of the upcoming turn (N400), 3) participants with a more efficient gaze predictive behaviour better solve semantic uncertainties at the turn onset, in particular in the most challenging listening condition. Our findings contribute to a better understanding of the relation between predictions, neural predictions errors and speech comprehension under challenging conditions.

Good scientific practice in EEG and MEG research: Progress and perspectives.

Good scientific practice (GSP) refers to both explicit and implicit rules, recommendations, and guidelines that help scientists to produce work that is of the highest quality at any given time, and to efficiently share that work with the community for further scrutiny or utilization. For experimental research using magneto- and electroencephalography (MEEG), GSP includes specific standards and guidelines for technical competence, which are periodically updated and adapted to new findings. However, GSP also needs to be regularly revisited in a broader light. At the LiveMEEG 2020 conference, a reflection on GSP was fostered that included explicitly documented guidelines and technical advances, but also emphasized intangible GSP: a general awareness of personal, organizational, and societal realities and how they can influence MEEG research. This article provides an extensive report on most of the LiveMEEG contributions and new literature, with the additional aim to synthesize ongoing cultural changes in GSP. It first covers GSP with respect to cognitive biases and logical fallacies, pre-registration as a tool to avoid those and other early pitfalls, and a number of resources to enable collaborative and reproducible research as a general approach to minimize misconceptions. Second, it covers GSP with respect to data acquisition, analysis, reporting, and sharing, including new tools and frameworks to support collaborative work. Finally, GSP is considered in light of ethical implications of MEEG research and the resulting responsibility that scientists have to engage with societal challenges. Considering among other things the benefits of peer review and open access at all stages, the need to coordinate larger international projects, the complexity of MEEG subject matter, and today's prioritization of fairness, privacy, and the environment, we find that current GSP tends to favor collective and cooperative work, for both scientific and for societal reasons.

Hippocampal and auditory contributions to speech segmentation.

Statistical learning has been proposed as a mechanism to structure and segment the continuous flow of information in several sensory modalities. Previous studies proposed that the medial temporal lobe, and in particular the hippocampus, may be crucial to parse the stream in the visual modality. However, the involvement of the hippocampus in auditory statistical learning, and specifically in speech segmentation is less clear. To explore the role of the hippocampus in speech segmentation based on statistical learning, we exposed seven pharmaco-resistant temporal lobe epilepsy patients to a continuous stream of trisyllabic pseudowords and recorded intracranial stereotaxic electro-encephalography (sEEG). We used frequency-tagging analysis to quantify neuronal synchronization of the hippocampus and auditory regions to the temporal structure of words and syllables of the learning stream. We also analyzed the event-related potentials (ERPs) of the test to evaluate the role of both regions in the recognition of newly segmented words. Results show that while auditory regions highly respond to syllable frequency, the hippocampus responds mostly to word frequency. Moreover, ERPs collected in the hippocampus show clear sensitivity to the familiarity of the items. These findings provide direct evidence of the involvement of the hippocampus in the speech segmentation process and suggest a hierarchical organization of auditory information during speech processing.

Does auditory deprivation impairs statistical learning in the auditory modality?

Early sensory deprivation allows assessing the extent of reorganisation of cognitive functions, well beyond sensory processing. As such, it is a good model to explore the links between sensory experience and cognitive functions. One of these functions, statistical learning - the ability to extract and use regularities present in the environment - is suspected to be impaired in prelingually deaf children with a cochlear implant. However, empirical evidence supporting this claim is very scarce and studies have reported contradictory results. This might be because previous studies have tested statistical learning only in the visual modality and did not make clear distinctions between multiple types of statistical regularities. To overcome these problems, we designed a modified serial reaction time task where cochlear implanted children and normal hearing children had to react to auditory sequences that embed multiple statistical regularities, namely transition probabilities of 0th, 1st or 2nd order. We compared the reaction times of the children with the output of a simple computational model that learns transition probabilities. First, 6-12 years old children were able to learn 0th and 1st order transition probabilities but not 2nd order ones. Second, there were no differences between cochlear implanted children and their normal hearing peers. These results indicate that auditory statistical learning is preserved in congenitally deaf children with cochlear implants. This suggests in turn that early auditory deprivation might not be crucially detrimental for the normal development of statistical learning.

Frequency Selectivity of Persistent Cortical Oscillatory Responses to Auditory Rhythmic Stimulation.

Cortical oscillations have been proposed to play a functional role in speech and music perception, attentional selection, and working memory, via the mechanism of neural entrainment. One of the properties of neural entrainment that is often taken for granted is that its modulatory effect on ongoing oscillations outlasts rhythmic stimulation. We tested the existence of this phenomenon by studying cortical neural oscillations during and after presentation of melodic stimuli in a passive perception paradigm. Melodies were composed of ∼60 and ∼80 Hz tones embedded in a 2.5 Hz stream. Using intracranial and surface recordings in male and female humans, we reveal persistent oscillatory activity in the high-γ band in response to the tones throughout the cortex, well beyond auditory regions. By contrast, in response to the 2.5 Hz stream, no persistent activity in any frequency band was observed. We further show that our data are well captured by a model of damped harmonic oscillator and can be classified into three classes of neural dynamics, with distinct damping properties and eigenfrequencies. This model provides a mechanistic and quantitative explanation of the frequency selectivity of auditory neural entrainment in the human cortex.SIGNIFICANCE STATEMENT It has been proposed that the functional role of cortical oscillations is subtended by a mechanism of entrainment, the synchronization in phase or amplitude of neural oscillations to a periodic stimulation. One of the properties of neural entrainment that is often taken for granted is that its modulatory effect on ongoing oscillations outlasts rhythmic stimulation. Using intracranial and surface recordings of humans passively listening to rhythmic auditory stimuli, we reveal consistent oscillatory responses throughout the cortex, with persistent activity of high-γ oscillations. On the contrary, neural oscillations do not outlast low-frequency acoustic dynamics. We interpret our results as reflecting harmonic oscillator properties, a model ubiquitous in physics but rarely used in neuroscience.

Musical Expertise Is Associated with Improved Neural Statistical Learning in the Auditory Domain.

It is poorly known whether musical training is associated with improvements in general cognitive abilities, such as statistical learning (SL). In standard SL paradigms, musicians have shown better performances than nonmusicians. However, this advantage could be due to differences in auditory discrimination, in memory or truly in the ability to learn sequence statistics. Unfortunately, these different hypotheses make similar predictions in terms of expected results. To dissociate them, we developed a Bayesian model and recorded electroencephalography (EEG). Our results confirm that musicians perform approximately 15% better than nonmusicians at predicting items in auditory sequences that embed either low or high-order statistics. These higher performances are explained in the model by parameters governing the learning of high-order statistics and the selection stage noise. EEG recordings reveal a neural underpinning of the musician's advantage: the P300 amplitude correlates with the surprise elicited by each item, and so, more strongly for musicians. Finally, early EEG components correlate with the surprise elicited by low-order statistics, as opposed to late EEG components that correlate with the surprise elicited by high-order statistics and this effect is stronger for musicians. Overall, our results demonstrate that musical expertise is associated with improved neural SL in the auditory domain. SIGNIFICANCE STATEMENT: It is poorly known whether musical training leads to improvements in general cognitive skills. One fundamental cognitive ability, SL, is thought to be enhanced in musicians, but previous studies have reported mixed results. This is because such musician's advantage can embrace very different explanations, such as improvement in auditory discrimination or in memory. To solve this problem, we developed a Bayesian model and recorded EEG to dissociate these explanations. Our results reveal that musical expertise is truly associated with an improved ability to learn sequence statistics, especially high-order statistics. This advantage is reflected in the electroencephalographic recordings, where the P300 amplitude is more sensitive to surprising items in musicians than in nonmusicians.

Temporal integration of short-duration pulse trains in cochlear implant listeners: Psychophysical and electrophysiological measurements.

While electrically-evoked auditory brainstem response (eABR) thresholds for low-rate pulse trains correlate well with behavioral thresholds measured at the same rate, the correlation is much weaker with behavioral thresholds measured at high rates, such as used clinically. This implies that eABRs to low-rate stimuli cannot be reliably used for objective programming of threshold levels in cochlear implant (CI) users. Here, we investigate whether the use of bunched-up pulses (BUPS), consisting of groups of closely-spaced pulses may be used as an alternative stimulus. Experiment 1 measured psychophysical detection thresholds for several stimuli having a period of 32 ms in nine CI subjects implanted with a Med-EL device. The stimuli differed in the number of pulses present in each period (from 1 to 32), the pulse rate within period (1000 pps and as high as possible for BUPS) and the electrode location (apical or basal). The correlation between psychophysical thresholds obtained for a high-rate (1000 pps) clinical stimulus and for the BUPS stimuli increased as the number of pulses per period of BUPS increased from 1 to 32. This first psychophysical experiment suggests that the temporal processes affecting the threshold of clinical stimuli are also present for BUPS. Experiment 2 measured eABRs on the apical electrode of eight CI subjects for BUPS having 1, 2, 4, 8, 16 or 32 pulses per period. For most subjects, wave V was visible for BUPS having up to 16 pulses per period. The latency of wave V at threshold increased as a function of the number of pulses per period, suggesting that the eABR reflects the integration of multiple pulses at such low levels or that the neural response to each individual pulse increases along the sequence due to facilitation processes. There was also a strong within-subject correlation between electrophysiological and behavioral thresholds for the different BUPS stimuli. This demonstrates that the drop in behavioral threshold obtained when increasing the number of pulses per period of the BUPS can be measured electrophysiologically using eABRs. In contrast, the across-subject correlation between eABR thresholds for BUPS and clinical thresholds remained relatively weak and did not increase with the number of pulses per period. Implications of the use of BUPS for objective programming of CIs are discussed.

Rhythmic Abilities of Children With Hearing Loss.

OBJECTIVES: Children with hearing loss (HL), in spite of early cochlear implantation, often struggle considerably with language acquisition. Previous research has shown a benefit of rhythmic training on linguistic skills in children with HL, suggesting that improving rhythmic capacities could help attenuating language difficulties. However, little is known about general rhythmic skills of children with HL and how they relate to speech perception. The aim of this study is twofold: (1) to assess the abilities of children with HL in different rhythmic sensorimotor synchronization tasks compared to a normal-hearing control group and (2) to investigate a possible relation between sensorimotor synchronization abilities and speech perception abilities in children with HL. DESIGN: A battery of sensorimotor synchronization tests with stimuli of varying acoustic and temporal complexity was used: a metronome, different musical excerpts, and complex rhythmic patterns. Synchronization abilities were assessed in 32 children (aged from 5 to 10 years) with a severe to profound HL mainly fitted with one or two cochlear implants (n = 28) or with hearing aids (n = 4). Working memory and sentence repetition abilities were also assessed. Performance was compared to an age-matched control group of 24 children with normal hearing. The comparison took into account variability in working memory capacities. For children with HL only, we computed linear regressions on speech, sensorimotor synchronization, and working memory abilities, including device-related variables such as onset of device use, type of device, and duration of use. RESULTS: Compared to the normal-hearing group, children with HL performed poorly in all sensorimotor synchronization tasks, but the effect size was greater for complex as compared to simple stimuli. Group differences in working memory did not explain this result. Linear regression analysis revealed that working memory, synchronization to complex rhythms performances, age, and duration of device use predicted the number of correct syllables produced in a sentence repetition task. CONCLUSION: Despite early cochlear implantation or hearing aid use, hearing impairment affects the quality of temporal processing of acoustic stimuli in congenitally deaf children. This deficit seems to be more severe with stimuli of increasing rhythmic complexity highlighting a difficulty in structuring sounds according to a temporal hierarchy.

Musical Training for Auditory Rehabilitation in Hearing Loss.

Despite the overall success of cochlear implantation, language outcomes remain suboptimal and subject to large inter-individual variability. Early auditory rehabilitation techniques have mostly focused on low-level sensory abilities. However, a new body of literature suggests that cognitive operations are critical for auditory perception remediation. We argue in this paper that musical training is a particularly appealing candidate for such therapies, as it involves highly relevant cognitive abilities, such as temporal predictions, hierarchical processing, and auditory-motor interactions. We review recent studies demonstrating that music can enhance both language perception and production at multiple levels, from syllable processing to turn-taking in natural conversation.

Asymmetric sampling in human auditory cortex reveals spectral processing hierarchy.

Speech perception is mediated by both left and right auditory cortices but with differential sensitivity to specific acoustic information contained in the speech signal. A detailed description of this functional asymmetry is missing, and the underlying models are widely debated. We analyzed cortical responses from 96 epilepsy patients with electrode implantation in left or right primary, secondary, and/or association auditory cortex (AAC). We presented short acoustic transients to noninvasively estimate the dynamical properties of multiple functional regions along the auditory cortical hierarchy. We show remarkably similar bimodal spectral response profiles in left and right primary and secondary regions, with evoked activity composed of dynamics in the theta (around 4-8 Hz) and beta-gamma (around 15-40 Hz) ranges. Beyond these first cortical levels of auditory processing, a hemispheric asymmetry emerged, with delta and beta band (3/15 Hz) responsivity prevailing in the right hemisphere and theta and gamma band (6/40 Hz) activity prevailing in the left. This asymmetry is also present during syllables presentation, but the evoked responses in AAC are more heterogeneous, with the co-occurrence of alpha (around 10 Hz) and gamma (>25 Hz) activity bilaterally. These intracranial data provide a more fine-grained and nuanced characterization of cortical auditory processing in the 2 hemispheres, shedding light on the neural dynamics that potentially shape auditory and speech processing at different levels of the cortical hierarchy.

A stimulus-brain coupling analysis of regular and irregular rhythms in adults with dyslexia and controls.

When listening to temporally regular rhythms, most people are able to extract the beat. Evidence suggests that the neural mechanism underlying this ability is the phase alignment of endogenous oscillations to the external stimulus, allowing for the prediction of upcoming events (i.e., dynamic attending). Relatedly, individuals with dyslexia may have deficits in the entrainment of neural oscillations to external stimuli, especially at low frequencies. The current experiment investigated rhythmic processing in adults with dyslexia and matched controls. Regular and irregular rhythms were presented to participants while electroencephalography was recorded. Regular rhythms contained the beat at 2 Hz; while acoustic energy was maximal at 4 Hz and 8 Hz. These stimuli allowed us to investigate whether the brain responds non-linearly to the beat-level of a rhythmic stimulus, and whether beat-based processing differs between dyslexic and control participants. Both groups showed enhanced stimulus-brain coherence for regular compared to irregular rhythms at the frequencies of interest, with an overrepresentation of the beat-level in the brain compared to the acoustic signal. In addition, we found evidence that controls extracted subtle temporal regularities from irregular stimuli, whereas dyslexics did not. Findings are discussed in relation to dynamic attending theory and rhythmic processing deficits in dyslexia.

Rhythmic Abilities Correlate with L2 Prosody Imitation Abilities in Typologically Different Languages.

While many studies have demonstrated the relationship between musical rhythm and speech prosody, this has been rarely addressed in the context of second language (L2) acquisition. Here, we investigated whether musical rhythmic skills and the production of L2 speech prosody are predictive of one another. We tested both musical and linguistic rhythmic competences of 23 native French speakers of L2 English. Participants completed perception and production music and language tests. In the prosody production test, sentences containing trisyllabic words with either a prominence on the first or on the second syllable were heard and had to be reproduced. Participants were less accurate in reproducing penultimate accent placement. Moreover, the accuracy in reproducing phonologically disfavored stress patterns was best predicted by rhythm production abilities. Our results show, for the first time, that better reproduction of musical rhythmic sequences is predictive of a more successful realization of unfamiliar L2 prosody, specifically in terms of stress-accent placement.

Rhythmic Training Improves Temporal Anticipation and Adaptation Abilities in Children With Hearing Loss During Verbal Interaction.

Purpose In this study, we investigate temporal adaptation capacities of children with normal hearing and children with cochlear implants and/or hearing aids during verbal exchange. We also address the question of the efficiency of a rhythmic training on temporal adaptation during speech interaction in children with hearing loss. Method We recorded electroencephalogram data in children while they named pictures delivered on a screen, in alternation with a virtual partner. We manipulated the virtual partner's speech rate (fast vs. slow) and the regularity of alternation (regular vs. irregular). The group of children with normal hearing was tested once, and the group of children with hearing loss was tested twice: once after 30 min of auditory training and once after 30 min of rhythmic training. Results Both groups of children adjusted their speech rate to that of the virtual partner and were sensitive to the regularity of alternation with a less accurate performance following irregular turns. Moreover, irregular turns elicited a negative event-related potential in both groups, showing a detection of temporal deviancy. Notably, the amplitude of this negative component positively correlated with accuracy in the alternation task. In children with hearing loss, the effect was more pronounced and long-lasting following rhythmic training compared with auditory training. Conclusion These results are discussed in terms of temporal adaptation abilities in speech interaction and suggest the use of rhythmic training to improve these skills of children with hearing loss.

Prolonged exposure to highly rhythmic music affects brain dynamics and perception.

Rhythmic stimulation is a powerful tool to improve temporal prediction and parsing of the auditory signal. However, for long duration of stimulation, the rhythmic and repetitive aspects of music have often been associated to a trance state. In this study we conceived an auditory monitoring task that allows tracking changes of psychophysical auditory thresholds. Participants performed the task while listening to rhythmically regular and an irregular (scrambled but spectrally identical) music that were presented with an intermittent (short) and continuous (long) type of stimulation. Results show that psychophysical auditory thresholds increase following a Continuous versus Intermittent stimulation and this is accompanied by a reduction of the amplitude of two event-related potentials to target stimuli. These effects are larger with regular music, thus do not simply derive from the duration of stimulation. Interestingly, they seem to be related to a frequency selective neural coupling as well as an increase of network connectivity in the alpha band between frontal and central regions. Our study shows that the idea that rhythmic presentation of sensory stimuli facilitates perception might be limited to short streams, while long, highly regular, repetitive and strongly engaging streams may have an opposite perceptual impact.

Music training enhances the automatic neural processing of foreign speech sounds.

Growing evidence shows that music and language experience affect the neural processing of speech sounds throughout the auditory system. Recent work mainly focused on the benefits induced by musical practice on the processing of native language or tonal foreign language, which rely on pitch processing. The aim of the present study was to take this research a step further by investigating the effect of music training on processing English sounds by foreign listeners. We recorded subcortical electrophysiological responses to an English syllable in three groups of participants: native speakers, non-native nonmusicians, and non-native musicians. Native speakers had enhanced neural processing of the formant frequencies of speech, compared to non-native nonmusicians, suggesting that automatic encoding of these relevant speech cues are sensitive to language experience. Most strikingly, in non-native musicians, neural responses to the formant frequencies did not differ from those of native speakers, suggesting that musical training may compensate for the lack of language experience by strengthening the neural encoding of important acoustic information. Language and music experience seem to induce a selective sensory gain along acoustic dimensions that are functionally-relevant-here, formant frequencies that are crucial for phoneme discrimination.